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- GAME STORAG E MEDIUM 

Technical Field 

The present invention relates to a game machine, a musical 
5 tone reproduction device, and an information storage medium 
that reproduce sounds and images that have been recorded on an 
optical disk. 

Background of Art 
10 To increase the interest and degree of excitement of a game 

produced by a game machine, game images are switched or certain 
of their attributes such as their color are changed in time with 
game music, or the controller or the seat in which the player 
is sitting is made to vibrate. 
15 in such a case, game sounds that are stored on an optical 

disk such as an ordinary compact disk are reproduced 
independently of the execution of the game program. To enable 
this in the conventional art, the time from the start of 
reproduction of the game sounds is obtained by counting from 
20 the game program side during the reproduction of game sounds 
from the compact disk, and images are generated in 
synchronization with the game sounds. 

However, in such a method, when a fault such as sound 
skipping occurs during reproduction from the compact disk, that 
25 fault will not be reflected in the program counter and it will 
no longer be possible to synchronize the program counter and 
the game sounds. This causes a problem in that slippage will 
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occur in images that ought to be generated in synchronization 
with game sounds . 



Disclosure of Invention 
5 The present invention was devised in the light of the above 

described technical problem, with the objective of providing 
a game machine, a musical tone generation device, and an 
information storage medium that make it possible to synchronize 
reproduced sounds and images, even if faults such as skips in 
10 those sounds or images occur during the reproduction of sounds 
and images that have been recorded on optical disk. 

1) A game machine in accordance with an aspect of the 
present invention comprises: an optical disk in which is 
included synchronization data for synchronizing with at least 
15 one of sound data and image data, within at least one of the 
sound data and image data; reproduction means for reproducing 
at least one of a sound and an image, based on at least one of 
the sound data and the image data accessed from the optical disk; 
and processing means for executing given processing in 
20 synchronization with at least one of sounds and images to be 
reproduced by reproduction means , based on synchronization data 
accessed from the optical disk. 

In this case, sound data includes data such as musical tone 
data on tunes used in a game, by way of example. 
25 This optical disk comprises media such as a CD, LD, MD, 

or DVD. 

With a processing means that performs given processing, 
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it is generally difficult to detect sound skipping, even if a 
fault such as sound skipping should occur during the 
reproduction of sounds from an optical disk. 

However, the present invention makes it possible to 

5 receive synchronization data that is accessed from the optical 
disk together with the reproduction of musical tones of a tune 
used in the game, for example, and perform given processing in 
synchronization with at least one of sounds and images to be 
reproduced by reproduction means , based on that synchronization 

10 data. For that reason, it is possible to synchronize or recover 
synchronization based on that synchronization data to perform 
various types of processing, even if sound skipping or image 
skipping occur in sounds and images reproduced from the optical 
disk. 

15 Recovery of synchronization means that synchronization 

can be recovered immediately by the synchronization data, if 
a fault such as sound skipping occurs so that there is a 
discrepancy in processing with respect to the sound. 

The synchronization data includes data indicating elapsed 
20 time since the start of the tune, data indicating a position 
or a delimiter of the tune, timing data determined in accordance 
with the rhythm, tempo, or beat of the tune, or counter data, 
by way of example. 

The synchronization data is preferably comprised at a 
25 constant spacing. 

In addition, the optical disk is preferably a compact disk. 
The compact disk in this case is formatted in such a manner that 
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it can be read by a game machine, such as a CD-ROM. To ensure 
that the sound data or image data for reproduction is processed 
simultaneously with the synchronization data in the game 
machine, it is preferable that this CD-ROM conforms with 
5 CD-ROMXA standard. Conformity with CD-ROMXA standard permits 
computer data to be interleaved with other data, such as audio 
data, so that the computer data and the audio data can be 
reproduced consecutively. In principle, computer data is 
allocated to empty areas by compressing the sound data. 
10 In a game machine using musical tones for tunes and image 

data, to be used in a game stored on a compact disk such as a 
CD-ROM, it is possible to obtain synchronization or recover such 
synchronization with the sounds and images that are reproduced 
from the compact disk, and perform image generation, even if 
15 sound skipping or image skipping occurs in the sounds and images 
reproduced from the compact disk. 

2) In the game machine of the present invention, at least 
one item of the synchronization data may be included within a 
range of data that is capable of being accessed simultaneously. 
20 In the present invention, it may be possible to achieve 

more accurate synchronization, because the synchronization 
data is always included within each range of data that can be 
accessed at a time. This also makes it possible to recover the 
synchronization more rapidly 
25 3) In the game machine of the present invention, the 

synchronization data may comprise data indicating at least one 
of elapsed time since reproduction start during normal 
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reproduction and elapsed time from a predetermined position. 

When synchronization with game music is done by an ordinary 
game program, the decision of the reproduction position of the 
tune is often done at a certain elapsed time since reproduction 
5 start or elapsed time from a predetermined position. The 
predetermined position could be a tune delimiter, by way of 
example. When sound skipping occurs in such a case, the program 
count will deviate from the tune reproduction, leading to a loss 
in synchronization. 

10 In the present invention, however, it may be possible to 

obtain an accurate tune reproduction position, by the game 
program referencing the synchronization data. Therefore, even 
if sound skipping occurs in the sound that is being reproduced 
from the optical disk, it is possible for the processing means 

15 to execute processing to obtain accurate synchronization or 
recover that synchronization with the sounds reproduced from 
the optical disk. 

4 ) The game machine of the present invention may further 
comprise a display section for displaying a game image, and the 

20 processing means may perform image generation processing on a 
game image to be displayed on the display section, in 
synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

25 The present invention can make it possible to obtain 

synchronization or recover the synchronization with sounds and 
images reproduced from the optical disk, even if sound skipping 
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or image skipping has occurred, and perform image generation. 

5) The game machine of the present invention may further 
comprise a game controller for inputting an operation by a 
player, and the processing means may perform processing for 

5 output to the controller, in synchronization with at least one 
of a sound and an image reproduced by the reproduction means, 
based on synchronization data of the optical disk. 

The controller is a device that the player uses to perform 
input operations of the game, and resistive forces, vibrations 
10 or the like are output therefrom. 

In the invention, it may be possible to obtain 
synchronization or recover the synchronization with sounds and 
images reproduced from the optical disk, even if sound skipping 
or image skipping has occurred, and output resistive forces, 
15 vibrations or the like to the controller. 

6) The game machine of the present invention may further 
comprise at least one of a player platform on which a player 
rides and a seat on which a player sits , and the processing means 
may perform processing for output to at least one of the player 

20 platform and the seat, in synchronization with at least one of 
a sound and an image reproduced by the reproduction means, based 
on synchronization data of the optical disk. 

A player platform is a game plate that resembles skis or 
a snowboard for a skiing game or snowboarding game, or a game 

25 housing that resembles a motorbike, racing bike, or horse for 
a motorbike, cycling, or horse-racing game, by way of example. 
Similarly, a seat on which a player sits is a driving seat for 
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a driving game or the like, or a seat that moves together with 
a image for an adventure game, by way of example. 

In the present invention, it may be possible to obtain 
synchronization or recover the synchronization with sounds and 
5 images reproduced from the optical disk, even if sound skipping 
or image skipping has occurred, and output vibrations or the 
like to a player platform on which the player rides or a seat 
on which the player sits. 

7) The game machine of the present invention may further 
10 comprise an optical signal output section, and the processing 

means may perform processing for output an optical signal to 
the optical signal output section, in synchronization with at 
least one of a sound and an image reproduced by the reproduction 
means, based on synchronization data of the optical disk. 
15 The optical signal output portion comprises an LED, 

operation indication bulb or the like provided outside the 
housing . 

In the present invention, it may be possible to obtain 
synchronization or recover the synchronization with sounds and 
20 images reproduced from the optical disk, even if sound skipping 
or image skipping has occurred, and output an optical signal. 

8 ) The present invention further relates to an optical disk 
that is readable by a game machine, the optical disk storing 
at least one of sound data and image data comprising 

25 synchronization data as defined by the present invention. 

9) The present invention also relates to an information 
storage medium for reading data from an optical disk in which 
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is included synchronization data for synchronizing with at 
least one of sound data and image data, within at least one of 
the sound data and image data, and performing given processing, 
the information storage medium comprising: information for 
5 reproducing at least one of a sound and an image, based on at 
least one of the sound data and the image data accessed from 
the optical disk; and information for executing given 
processing in synchronization with at least one of sounds and 
images to be reproduced by reproduction means , based on 

10 synchronization data accessed from the optical disk. 

This optical disk and the information storage medium of 
the present invention could be the physically same medium. In 
other words, the optical disk could be configured to comprise 
data that is at least one of sound data and image data, and 

15 synchronization data included within that data, for obtaining 
synchronization with at least one of the sound data and image 
data; and also comprise information for accessing data from that 
optical disk and reproducing at least one of sounds and images, 
based on at least one of sound data and image data on the optical 

20 disk; and information for fetching synchronization data that 
has been accessed from the optical disk, for synchronizing with 
at least one of sounds and images to be reproduced, based on 
that synchronization data, and for performing given processing . 
The information storage medium of the present invention 

25 preferably further comprises information for synchronizing 
with at least one of sounds and images to be reproduced, based 
on the synchronization data, and for performing image 



generation processing of game images to be displayed on a 
display section. 

The information storage medium of the present invention 
preferably further comprises information for synchronizing 
5 with at least one of sounds and images to be reproduced, based 
on the synchronization data, and for processing sounds for 
output to the controller. 

The information storage medium of the present invention 
preferably further comprises information for synchronizing 
10 with at least one of sounds and images to be reproduced, based 
on the synchronization data, and for processing outputs to at 
least one of the player platform and the seat. 

The information storage medium of the present invention 
preferably further comprises information for synchronizing 
15 with at least one of sounds and images to be reproduced, based 
on the synchronization data, and for outputting optical signals 
to an optical signal output section. 

10) In the information storage medium of the present 
invention, at least one item of the synchronization data may 

20 be included within a range of data that is capable of being 
accessed simultaneously. 

11) In the information storage medium of the present 
invention, the synchronization data may comprise data 
indicating at least one of elapsed time since reproduction start 

25 during normal reproduction and elapsed time from a 
predetermined position. 

12) The present invention still relate to a musical tone 
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reproduction device comprises: an optical disk in which is 
included synchronization data for synchronizing with sound data 
within the sound data; image data storage means in which is 
included image data; reproduction means for reproducing a tune, 
5 based on the sound data accessed from the optical disk; and image 
reproduction means for synchronizing with the tune to be 
reproduced, based on the synchronization data accessed from the 
optical disk, and for performing reproduction processing on an 
image that is stored in the image data storage means. 

10 For example, when karaoke tunes are stored on an optical 

disk and background images for the karaoke are recorded on a 
storage medium that is separate from that containing the tunes, 
the present invention can make it possible to synchronize 
accurately or recover that synchronization with tunes 

15 reproduced from the optical disk, even if sound skipping of the 
tunes occurs, and to perform image reproduction processing. 

13) In the musical tone reproduction device of the present 
invention, at least one item of the synchronization data may 
be included within a range of data that is capable of being 

20 accessed simultaneously. 

14 ) In the musical tone reproduction device of the present 
invention, the synchronization data may comprise data 
indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 

25 predetermined position. 

15) The present invention still further relates to an 
information storage medium for reading data from an optical disk 
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in which is comprised synchronization data for synchronizing 
with sound data, within the sound data, and performing given 
processing, the information storage medium comprising: 
information for reproducing a tune, based on the sound data 
5 accessed from the optical disk; and information for 
synchronizing with a tune to be reproduced by the reproduction 
means, based on the synchronization data accessed from the 
optical disk, and performing image reproduction processing. 

16) In the information storage medium of the present 
10 invention, at least one item of the synchronization data may 

be included within a range of data that is capable of being 
accessed simultaneously. 

17) In the information storage medium of the present 
invention, the synchronization data may comprise data 

15 indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 
predetermined position. 

Brief Description of Drawings 
20 Fig. 1 is illustrative of slippage between game sounds and 

displayed images when sound skipping occurs in a conventional 
art system; 

Fig. 2 is illustrative of an example of synchronization 
between game sounds and images when sound skipping has occurred, 
25 using the method of the present invention; 

Figs. 3A and 3B show physical images of data recorded on 

a CD; 
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Fig. 4 is a view schematically showing the recording format 
of data on a CD-ROMXA; 

Fig. 5 is illustrative of processing that is executed when 
elapsed time since the start of a tune has been stored in the 
5 data channel; 

Fig. 6 is illustrative of display images that are displayed 
at tune delimiters every ten seconds; 

Fig. 7 is a flowchart of the operation of switching the 
display images of Fig. 6 at tune delimiters every ten seconds; 
10 Fig. 8 shows a functional block diagram of a game machine 

in accordance with this embodiment of the invention; 

Fig. 9 shows an example of a structure of hardware that 
can implement this embodiment; 

Figs. 10A, 10B, and 10C show various different forms of 
15 machines to which the present invention can be applied. 

Best Mode for Carrying Out the Invention 

Preferred embodiments of the present invention are 

described below with reference to the accompanying drawings . 
20 The characteristics of the present invention will first 

be described with reference to a conventional-art example, 

taking a case in which synchronization is obtained between 

sounds and images. 

When game images are generated in synchronization with 
25 game sounds that are reproduced from a compact disk (hereinafter 

abbreviated to CD) , by way of example, the reproduction position 

of the current game sound is obtained in the prior art by having 
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the game program count at the same time that the reproduction 
starts. Thus, if some sort of fault should occur in the CD (due 
to shock, or the like) , slippage will occur between the counter 
in the game program and the actual reproduction position. 
5 An illustration of slippage between game sounds and 

displayed images when sound skipping occurs in a conventional 
system is shown in Fig. 1. Actual time is denoted by time t and 
the counter of the game program is synchronized with this actual 
time. The description that follows concerns a situation in which 
10 the game music has tune delimiters at 10-second intervals and 
switching of displayed images is synchronized with these tune 
delimiters . 

in such a case, if the count on the game program side starts 
at the same time that a tune starts and processing is done to 

15 switch the displayed image every 10 seconds, the displayed 
images ought to be switched every time there is a delimiter in 
the game music. 

Assume, however, that a sound skip occurs between 10 
seconds and 20 seconds after a tune starts, as shown in Fig. 

20 1 (see reference number 130) . In this case, tune delimiters that 
originally came after 10 seconds, 20 seconds, 30 seconds, etc. 
are generated at 110-2, 110-3,... and slippages (140-3, 
140-4,...) are generated away from the game program counts 
(150-3, 150-4,...). Since the displayed images are switched in 

25 accordance with the game program counter, slipping will occur 
in the switching timing of the tune delimiters and the displayed 
images, and it will not be possible to recover from this slippage 
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between game sounds and displayed images . 

In contrast thereto, the method of the present invention 
makes it possible to design for rapid synchronization recovery 
if such sound skipping should occur. In accordance with the 
5 present invention, synchronization data is incorporated at a 
constant spacing within the sound data, making it possible to 
read the sound data and synchronization data at the same time. 
When synchronization is obtained between the game sounds and 
the displayed images, the images are switched on the basis of 

10 this synchronization data. 

More specifically, synchronization data that can 
determine tune delimiters is inserted at positions that are read 
simultaneously with the sound data, for example. On the game 
program side, processing is done to switch the displayed image 

15 when synchronization data indicating such a tune delimiter is 
read. 

An illustration of the use of the method of the present 
invention, showing an example of the synchronization of game 
sounds and images when sound skipping has occurred, is shown 

20 in Fig. 2. 

Assume that a sound skip occurs between 10 seconds and 20 
seconds after a tune starts, in the same way as shown in Fig. 
1 {see reference number 230). In the configuration of the 
present invention, synchronization data that indicates the tune 

25 delimiter that ought to be detected after 20 seconds from the 
tune start is detected at the point 210-3, which is earlier by 
amount of the sound slippage (see 240). The displayed images 
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are switched at that point. It is therefore possible to switch 
the displayed images in complete synchronization with the tune 
delimiter 210-2 , 210-3,..., even if sound skipping has 
occurred. 

5 The description now turns to the format in which data is 

stored on a CD-ROMXA that is employed by this embodiment of the 
invention. The CD-ROMXA differs from an ordinary music CD in 
that sound data is stored thereon in a compressed form. Physical 
images of data stored on a CD are shown in Figs. 3A and 3B. 

10 Fig. 3A is illustrative of the format of data storage on 

a CD used in this embodiment of the invention. This format is 
mainly applicable to CDs containing game software that is used 
in domestic TV game machines. A game program and game data are 
stored in a CD-ROM format that can be read by a computer on inner 

15 tracks 270 of this CD. Outer tracks 260 of the CD contain sound 
data and synchronization data in CD-ROMXA format. 

The outer tracks of the CD 250 of Fig. 3A comprise a 
plurality of sectors of data 320-1 , 320-2 , . . . , as shown in Fig. 
3B, where the CD-ROMXA configuration is such that eight channels 

20 of sound can be stored thereon. 

In this case, the tune data is divided into sector units 
for storage, where eight channels of data are sequentially read 
during tune reproduction, then one channel of data is reproduced. 
In this embodiment of the invention, one channel out of eight 

25 channels is allocated to a data channel. 

The data storage format used with CD-ROMXA is shown 
schematically in Fig. 4. In this figure, seven out of eight 
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channels are tune channels and one channel is a data channel. 
Reference number 410 denotes the direction of reading of the 
CD. The configuration is such that eight sectors, which are 
sectors for eight channels, can be read simultaneously at least 
5 once. Reference number 420 denotes the direction of 
reproduction. When tune number 1 is being reproduced, by way 
of example, sound data stored in the sectors 452, 454, and 456 
are read in that sequence for reproduction. 

The description now turns to an example of an embodiment 
10 that obtains synchronization between tunes and images, using 
the method of the present invention. 

in this embodiment of the invention, elapsed time since 
the start of a tune is synchronized with images stored in the 
data channel. An illustration of the processing that is executed 
15 when elapsed time since the start of a tune has been stored in 
the data channel is shown in Fig. 5. 

It is possible to calculate the elapsed time since the 
start of the tune from the speed at which data is read from the 
recording medium. With a CD, 3 00 kilobytes of data are read 
20 within one second. This means that 150 sectors of data are read 
in one second. Therefore, the time required for reading eight 
channels of data is given by the following formula: 

l(second) -i. 150(sector) x 8(sector) = 0 . 0533 ...( seconds ) 
In other words, the time taken to read eight channels of 
25 data is 0.053 seconds. Therefore, it is possible to store data 
that represents elapsed time since the start of a tune, by 
storing marks indicating sequential increments of 0.053 seconds 
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in the data channel, as shown in Fig. 5. 

The description now turns to an example of the reading of 
the synchronization simultaneously with the tune and the 
switching of images at tune delimiters every ten seconds. 
5 An illustrative view of display images that are displayed 

at tune delimiters every ten seconds is shown in Fig. 6. Assume 
that a display image 510-1 is displayed within ten seconds from 
the start of the tune, 510-2 is displayed from ten seconds to 
less than 20 seconds, 510-3 is displayed from 20 seconds to less 
10 than 30 seconds, and 510-4 is displayed from 30 seconds to less 
than 40 seconds. Assume that the display images 510-1, 510- 
2, 510-3, and 510-4 have image numbers 0, 1, 2, and 3, 
respectively. 

A flowchart of the operation of switching the display 
15 images of Fig. 6 at the tune delimiters every ten seconds is 
shown in Fig. 7. 

When tune reproduction starts, the synchronization data, 
which was stored in the data channel that was read 
simultaneously with the accessing of the tune, is obtained 
20 (steps S10 and S20). The number of seconds of the obtained 
synchronization data is divided by ten, and the image 
corresponding to the image number of the value of the thus- 
obtained quotient is displayed on the screen (step S30). When 
the thus-obtained quotient is 0, for example, 510-1 is 
25 displayed; when it is 1 , 510-2 is displayed; when it is 2 , 510-3 
is displayed, and when it is 3, 510-4 is displayed. The 
processing of steps S20 and S3 0 is repeated until the tune ends 
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(step S40) . 

The synchronization data that was read simultaneously with 
the tune always corresponds to the position of the tune to be 
reproduced next. This means that, if sound skipping does occur 
5 during this process, the synchronization that was read in 
simultaneously with the tune corresponds to the position of the 
tune to be reproduced, after the sound skipping has occurred. 
Thus the present invention makes it possible to switch images 
with accurate synchronization with tunes, even if sound 

10 skipping or the like occurs during reproduction. 

Note that the data recorded in the data channel is not 
particularly limited and thus it could equally well be image 
information such as a counter or image color matched to the beat 
of a tune, the shape of a physical object when it is displayed 

15 in three dimensions on a screen, or positional information of 
a physical camera. In addition, the configuration could equally 
well be such that synchronization data, such as elapsed time 
since the start of a tune, could be comprised together with other 
information. 

20 An example of a functional block diagram of a game machine 

in accordance with this embodiment of the invention is shown 
in Fig. 8. In this case, an operating section 10 enables a player 
to input operating information by operating controls such as 
a joystick, buttons, a steering wheel, or an accelerator, and 

25 operation information that is obtained by the operating section 
10 is input to a game computation section 30. 

An optical disk 90 stores a game program 92, image data 
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94 such as object information used in image generation, and 
sound data 96 for reproducing game sounds. 

The game computation section 30 performs processing such 
as for game execution, setting various game modes, sending 
5 reproduction instructions to a sound reproduction section 60, 
and supplying information necessary for image generation to a 
image generation section 50, based on various types of 
information such as the above described operation information, 
the game program 92, and sound data 96 stored on the optical 

10 disk 90. The functions thereof can be implemented by hardware 
such as the CPU or memory. 

The image generation section 50 generates the game images, 
based on the processing results of the game computation section 
30 and the image data 94 that is stored on the optical disk, 

15 and the functions thereof can be implemented by an image 
generation IC (a dedicated IC, CPU, or DSP), and it can be 
implemented by hardware such as memory. Images generated by the 
image generation section 50 are displayed on a display section 
70. 

20 The sound reproduction section 60 generates game sounds 

(game music, effect sounds, voices, etc.) based on the 
processing results of the game computation section 30, and the 
functions thereof can be implemented by hardware such as a sound 
processing IC, an ADPCM decoder, a D/A converter, a low-pass 

25 filter, and memory. Game sounds reproduced by the sound 
reproduction section 60 are output by a sound output section 
80. 
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The game computation section comprises a synchronization 
processing section 40. The synchronization processing section 
4 0 performs processing to obtain synchronization of generated 
images with the game sounds when the sound data is being 
5 reproduced, based on the synchronization data that is recorded 
within the sound data. 

In this embodiment of the invention, when the game 
computation section 30 instructs the reproduction of 
predetermined sound data that is recorded on the optical disk, 

10 based on the game state, the sound data 96 that has been read 
from the optical disk 90 is reproduced by the sound reproduction 
section 60 and is output to the sound output section 80. 

During this time, the synchronization processing section 
40 performs processing such as that described by way of example 

15 with reference to Fig. 7, based on the synchronization data that 
was read together with the sound data, then instructs the timing 
of image switching and images to be created by the image 
generation section 50. Since the images are generated on the 
basis of these instructions from the synchronization processing 

20 section 40, it is possible to reproduce images in 
synchronization with the reproduced sounds . 

The description now turns to an example of hardware for 
a game machine that can implement this embodiment of the 
invention, with reference to Fig. 9. In the game machine shown 

25 in this figure, a CPU 1000, ROM 1002, RAM 1004, an information 
storage medium 1006, an optical disk 1007, a sound reproduction 
device 1400, a sound processing IC 1008, an image generation 
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IC 1010, and I/O ports 1012, 1014, and 1030 are connected 
together by a system bus 1016 in such a manner that data can 
be mutually transferred therebetween. A display 1018 is 
connected to the image generation IC 1010, a speaker 1020 is 
5 connected to the sound reproduction device 1400, a control 
device 1022 is connected to the I/O port 1012, a communication 
device 1024 is connected to the I/O port 1014, and various output 
devices 1034 are connected to the I/O port 1030. 

The information storage medium 1006 is mainly used for 

10 storing a game program and image information for representing 
display objects, where means such as a CD-ROM, game cassette, 
IC card, magneto-optical device, floppy-disk device, or memory 
could be used therefor. It should be noted, however, that the 
sound data or image data, which is recorded together with the 

15 synchronization data that is the characteristic point of the 
present invention, is stored in the optical disk 1007. 

The optical disk 1007 contains sound data or image data 
that is recorded together with the synchronization data that 
is the characteristic point of the present invention, and it 

20 could also contain other data such as a game program, image data, 
and sound data (tone data, score data, and waveform data) . Note 
that the information storage medium 1006 need not be provided 
if all the data and the program necessary for the game can be 
stored within this optical disk alone. 

25 The ROM 1002 contains data such as initialization 

information for the main game machine. 

The control device 1022 is equivalent to a game controller 
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and is an apparatus for inputting to the main game machine the 
results of decisions made by the player as the game progresses. 

The various output devices 1034 are equivalent to a seat 
or player platform that vibrates in synchronization with sounds 
5 and images, for example, or an optical signal output apparatus, 
and these devices are used for outputting vibrations, resistive 
forces or the like as the game progresses. 

The CPU 1000 controls the entire apparatus and performs 
various types of processing in accordance with factors such as 

10 the game program stored in the optical disk 1007 or the 
information storage medium 1006, or signals that are input by 
the control device 1022. The RAM 1004 is a storage means used 
as a work area of this CPU 1000, and data such as given contents 
of the optical disk 1007, the information storage medium 1006, 

15 or the ROM 1002, or computational results of the CPU 1000 are 
stored therein. 

With this type of game machine, the configuration is such 
that game sounds and game images provided by the sound 
processing IC 1008 and the image generation IC 1010 are output 

20 as appropriate. The sound processing IC 1008 performs various 
types of processing for generating game sounds such as game 
music, effect sounds, and voices, based on instructions from 
the CPU 1000 and data such as a game program, tone data, and 
score data from the RAM 1004, the information storage medium 

25 1006, and the optical disk 1007. The thus generated game sounds 
are output by the speaker 1020, via other components such as 
the sound reproduction device 1400. 
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The sound reproduction device 1400 comprises an ADPCM 
decoder 1416, an D/A converter 1418, a low-pass filter 1420, 
and an electronic volume 1422. 

The ADPCM decoder 1416 generates digital sound signals 
5 that are to be output, based on the processing results of the 
sound processing IC 1008 and waveform data (data representing 
the actual physical waveforms of sounds made by instruments such 
as a drum or piano) from the optical disk 1007 or the like, and 
outputs them to the D/A converter 1418. The D/A converter 1418 

10 converts these digital signals to analog signals and outputs 
them to the low-pass filter 1420. The output of the low-pass 
filter 1420 is then input to the electronic volume 1422. The 
electronic volume 1422 adjusts the magnitude of the sound in 
accordance with instructions from the sound processing IC 1008. 

15 The output of the electronic volume 1422 is input through an 
amplifier 1424 to the speaker 1020, which outputs sounds such 
as game music, effect sounds, and voices to the exterior. 

The image generation IC 1010 is an integrated circuit that 
synthesizes pixel information for output to the display 1018, 

20 based on image information sent from components such as the RAM 
1004, the ROM 1002, the information storage medium 1006, and 
the optical disk 1007. Note that a device called a head-mounted 
display (HMD) could also be used as the display 1018. 

The communication device 1024 exchanges various items of 

25 information used within the interior of the game machine, to 
and from the exterior, and it can be used to transfer given 
information to and from another game machine connected thereto, 
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in accordance with a game program, or to transfer information 
such as a game program over a communication line. 

The processing described with reference to Figs. 1 to 8 
is implemented by components such as the optical information 
5 storage medium 1006 storing a game program, the CPU 1000 that 
operates in accordance with that game program, and the image 
generation IC 1010. Note that processing performed by the image 
generation IC 1010 and the sound processing IC 1008 could also 
be done in a software manner by the CPU 1000 or an ordinary DSP. 

10 An example of this embodiment of the invention applied to 

an arcade game machine is shown in Fig. 10A. A player enjoys 
the game by operating controls such as a joystick 1102 and 
buttons 1104 while viewing a game image shown on a display 1100. 
Components such as a CPU, an image generation IC, and a sound 

15 processing IC are mounted on an IC board 1106 incorporated into 
the game machine. Information for playing the game and 
information for synchronizing game sounds or the like with game 
images or the like are stored in memory 1108, which is an 
information storage medium on the IC board. These types of 

20 information are hereinafter called stored information. This 
stored information comprises at least one type of information, 
such as program coding for executing the above described 
processing, image information, shape information for display 
objects, table data, or player information. Sound data 

25 comprising synchronization data is stored on optical disk (not 
shown in the figures), and various types of processing for 
synchronization with game sounds are performed on the basis of 
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this sound data and the stored information. 

An example of this embodiment applied to a domestic game 
machine is shown in Fig. 10B. Players enjoy the game by operating 
game controllers 1202 and 1204 while viewing a game image shown 
5 on a display 1200. In this case, sound data that comprises the 
above described stored information and synchronization data is 
stored in a CD-ROM 1206, which is an information storage medium 
that can be freely inserted into and removed from the main unit. 
An example of this embodiment applied to a game machine 

10 is shown in Fig. 10C where the game machine comprises a host 
machine 1300 and terminals 13 04-1 to 1304-n connected to the 
host machine 1300 by communication lines 1302. In this case, 
the above described stored information is stored in an 
information storage medium 1306 such as a magnetic disk device, 

15 magnetic tape device, or memory that can be controlled by the 
host machine 1300. Each of the terminals 1304-1 to 1304-n has 
a CPU, an image generation IC, and a sound processing IC. In 
addition, if game images and sounds can be synthesized by the 
terminals 1304-1 to 1304-n in a stand-alone manner, means such 

20 as a game program for synthesizing game images and sounds is 
transferred thereto from the host machine 1300. In this case, 
the sound data comprising synchronization data could be stored 
on an optical disk or the like which is provided on the terminal 
side. If game images and sounds cannot be synthesized thereby, 

25 on the other hand, the host machine 1300 could synthesize the 
game images and sounds and output them to a terminal for transfer 
to the terminals 1304-1 to 1304-n. In that case, the sound data 
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comprising synchronization data could be stored on an optical 
disk or the like which is provided on the host side. 

Note that the present invention is not limited to the above 
described embodiment and thus it can be modified in various 
5 ways . 

This embodiment was described as relating to an example 
in which images are synchronized with game music that is stored 
on compact disk, but the invention is not limited thereto. 
It is also not limited to something stored on compact disk; 

10 it could equally well concern something stored on any other kind 
of optical disk, such as an LD, MD, or DVD. It is similarly not 
limited to game music; it can also be applied to other sounds 
or movie data for moving images. 

The above embodiment was further described as relating to 

15 an example of generating images in synchronization with tunes, 
but the items to be output in synchronization are not limited 
to images. For example, vibration or resistive forces could be 
output to the controller that is operated by the player. 
Furthermore, a seat on which a player sits or a platform that 

20 models skis or the like, on which the player rides, could be 
made to vibrate in synchronization with musical tone data or 
images stored on optical disk. Alternatively, optical signals 
could be output in synchronization with tunes or images . 

Furthermore, the above embodiment was described with 

25 reference to an example in which tunes and images were 
synchronized accurately without any slippage, even if sound 
skipping has occurred. However, the present invention is not 
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limited thereto. Synchronization may also be recovered after 
a temporary slippage between images and tunes has occurred, by 
way of example. With prior-art methods, it is not possible for 
the game program to detect sound skipping or like that occurs 
5 during reproduction, so it is difficult to recover when a 
temporary slippage has occurred. The present invention, however, 
makes it possible to recover synchronization rapidly, even if 
a temporary slippage should occur. 

This embodiment of the invention was also described above 

10 with reference to an example in which synchronization data is 
data indicating the elapsed time from the start of a tune, but 
the present invention is not limited thereto and thus it could 
be data indicating a tune position or delimiter, timing data 
determined in accordance with the rhythm, tempo, or beat of the 

15 tune, or counter data, by way of example. 

In addition, the present invention can be applied to 
various game machines such as domestic game machines, arcade 
game machines, simulators, large-scale attractions in which 
many players can participate, and personal computers. 

20 The present invention is also not limited to game machines ; 

it can also be applied to karaoke devices or the like. 

If background images and effect sounds are output in 
synchronization with musical accompaniment sounds that are 
recorded on optical disk, by way of example, it is possible to 

25 provide a karaoke device that can output background images and 
effect sounds in synchronization with those musical 
accompaniment sounds, even if sound skipping occurs therein. 



27 



CLAIMS 



1. A game machine comprising: 

an optical disk in which is included synchronization data 
5 for synchronizing with at least one of sound data and image data, 
within at least one of the sound data and image data; 

reproduction means for reproducing at least one of a sound 
and an image, based on at least one of the sound data and the 
image data accessed from the optical disk; and 
10 processing means for executing given processing in 

synchronization with at least one of sounds and images to be 
reproduced by reproduction means , based on synchronization data 
accessed from the optical disk. 

15 2. The game machine as defined in claim 1, 

wherein at least one item of the synchronization data is 
included within a range of data that is capable of being accessed 
simultaneously. 

20 3. The game machine- as defined in claim 1, 

wherein the synchronization data comprises data 
indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 
predetermined position. 

25 

4. The game machine as defined in claim 2, 

wherein the synchronization data comprises data 
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indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 
predetermined position. 

5 5. The game machine as defined in claim 1, further comprising 
a display section for displaying a game image, 

wherein the processing means performs image generation 
processing on a game image to be displayed on the display section, 
in synchronization with at least one of a sound and an image 

10 reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

6. The game machine as defined in claim 4, further comprising 
a display section for displaying a game image, 

15 wherein the processing means performs image generation 

processing on a game image to be displayed on the display section, 
in synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

20 

7. The game machine as defined in claim 1, further comprising 
a game controller for inputting an operation by a player, 

wherein the processing means performs processing for 
output to the controller, in synchronization with at least one 
25 of a sound and an image reproduced by the reproduction means, 
based on synchronization data of the optical disk. 
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8 . The game machine as defined in claim 4 , further comprising 
a game controller for inputting an operation by a player, 

wherein the processing means performs processing for 
output to the controller, in synchronization with at least one 
5 of a sound and an image reproduced by the reproduction means, 
based on synchronization data of the optical disk. 

9. The game machine as defined in claim 1, further comprising 
at least one of a player platform on which a player rides and 

10 a seat on which a player sits, 

wherein the processing means performs processing for 
output to at least one of the player platform and the seat, in 
synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 

15 data of the optical disk. 

10 . The game machine as defined in claim 4 , further comprising 
at least one of a player platform on which a player rides and 
a seat on which a player sits, 
20 wherein the processing means performs processing for 

output to at least one of the player platform and the seat, in 
synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

25 

11 . The game machine as defined in claim 1 , further comprising 
an optical signal output section, 
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wherein the processing means performs processing for 
output an optical signal to the optical signal output section, 
in synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

12 . The game machine as defined in claim 4 , further comprising 
an optical signal output section, 

wherein the processing means performs processing for 
output an optical signal to the optical signal output section, 
in synchronization with at least one of a sound and an image 
reproduced by the reproduction means, based on synchronization 
data of the optical disk. 

13. An optical disk that is readable by a game machine, the 
optical disk storing at least one of sound data and image data 
comprising synchronization data as defined in claim 1. 

14. An optical disk that is readable by a game machine, the 
optical disk storing at least one of sound data and image data 
comprising synchronization data as defined in claim 2. 

15. An optical disk that is readable by a game machine, the 
optical disk storing at least one of sound data and image data 
comprising synchronization data as defined in claim 3. 

16. An information storage medium for reading data from an 
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optical disk in which is included synchronization data for 
synchronizing with at least one of sound data and image data, 
within at least one of the sound data and image data, and 
performing given processing, the information storage medium 
comprising: 

information for reproducing at least one of a sound and 
an image, based on at least one of the sound data and the image 
data accessed from the optical disk; and 

information for executing given processing in 
synchronization with at least one of sounds and images to be 
reproduced by reproduction means , based on synchronization data 
accessed from the optical disk. 

17. The information storage medium as defined in claim 16, 
wherein at least one item of the synchronization data is 

included within a range of data that is capable of being accessed 
s imult aneous ly . 

18. The information storage medium as defined in claim 16, 
wherein the synchronization data comprises data 

indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 
predetermined position. 

19. A musical tone reproduction device comprising: 

an optical disk in which is included synchronization data 
for synchronizing with sound data, within the sound data; 
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image data storage means in which is included image data; 

reproduction means for reproducing a tune, based on the 
sound data accessed from the optical disk; and 

image reproduction means for synchronizing with the tune 
5 to be reproduced, based on the synchronization data accessed 
from the optical disk, and for performing reproduction 
processing on an image that is stored in the image data storage 
means . 

10 20. The musical tone reproduction device as defined in claim 
19, 

wherein at least one item of the synchronization data is 
included within a range of data that is capable of being accessed 
simultaneously. 

15 

21. The musical tone reproduction device as defined in claim 
19, 

wherein the synchronization data comprises data 
indicating at least one of elapsed time since reproduction start 
20 during normal reproduction and elapsed time from a 
predetermined position. 

22. An information storage medium for reading data from an 
optical disk in which is comprised synchronization data for 

25 synchronizing with sound data, within the sound data, and 
performing given processing, the information storage medium 
comprising: 
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information for reproducing a tune, based on the sound data 
accessed from the optical disk; and 

information for synchronizing with a tune to be reproduced 
by the reproduction means, based on the synchronization data 
5 accessed from the optical disk, and performing image 
reproduction processing. 

23. The information storage medium as defined in claim 22, 
y wherein at least one item of the synchronization data is 

10 included within a range of data that is capable of being accessed 
s imultaneously . 

24. The information storage medium as defined in claim 22, 
wherein the synchronization data comprises data 

15 indicating at least one of elapsed time since reproduction start 
during normal reproduction and elapsed time from a 
predetermined position. 
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ABSTRACT 



The objective of the present invention is to provide a game 
machine, a musical tone generation device, and an information 
5 storage medium that make it possible to synchronize reproduced 
sounds and images, even if faults such as skips in those sounds 
or images occur during the reproduction of sounds and images 
that have been recorded on optical disk. When a game 
computation section (30) in this game machine instructs the 

10 reproduction of given sound data that has been recorded on an 
optical disk, based on the game state, sound data (96) that has 
been read from an optical disk (90) is reproduced by a sound 
reproduction section (60) and is output to a sound output 
section (80). During this time, a synchronization processing 

15 section (40) performs processing to obtain synchronization with 
the reproduced sounds, based on synchronization data that was 
read in together with the sound data, and instructs the images 
to be reproduced by an image generation section (50) and also 
the timing at which images are switched. Since image 

20 reproduction is based on instructions from the synchronization 
processing section (40) in this manner, the images can be 
reproduced in synchronization with the reproduced sounds . 
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the prior application and the national or PCT International filing 
date of application: 



(Application No.) (Filing Date) 



(Application No.) (Filing Date) 

nmxtb *> ^ fro&^A^ htzmmttmm b£ t z iz&-3 < 
life, x fctsEfc: if i?r s ft & mmcomm &9<t>tiz z t*mm 

U ^^XZZ\Z±M<DZ-t<t.m^WLL^to 



(Status: Patented, Pending, Abandoned) 



(Status: Patented, Pending, Abandoned) 

(mu : ^fFffRi^K ^m<Ps mmm) 

I hereby declare that all statements made herein of my own 
knowledge are true and that all statements made on information 
and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or 
imprisonment, or both, under Section 1001 of Title 18 of the 
United States Code and that such willful false statements may 
jeopardize the validity of the application or any patent issued 
thereon. 
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Japanese Language Declaration 



James A. Oliff, (Reg. ZimSL 
William P. Berridge, (Reg. .3&.Q241 
Kirk M. Hudson, (Reg._2X5fi2) 
Thomas J. Pardini, (Regji0444) 
Edward P. Walker, (Reg^34*4§& 
Robert A. Miller, (Reg. J£L77J)^ 
Mario A. Costantino, (Reg. 33,565) 



POWER OF ATTORNEY: As a named inventor, I hereby appoint the 
following attorney(s) and/or agent(s) to prosecute this application 
and transact all business in the Patent and Trademark Office 
connected therewith, (list name and registration number) 

James A. Oliff, (Reg. 27,075) 

William P. Berridge, (Reg.JO024) 

Kirk M. Hudson, (Reg._2Z5.S2l, 

Thomas J. Pardini, (Reg^OJll) 

Edward P. Walker, (Reg. 

Robert A. Miller, (Reg. 32J_Zll^ 

Mario A. Costantino, (Reg. 33,565) 



OLIFF & BERRIDGE, PLC 
P.O. Box 19928 
Alexandria, Virginia 22320 



Send Correspondence to: 

OLIFF & BERRIDGE, PLC 



__AJejcandda._yji^inia 



OLIFF & BERRIDGE, PLC 
(703) 836-6400 



Direct Telephone Calls to: (name and telephone number) 
OLIFF & BERRIDGE, PLC 
(703) 836-6400 



B£-SfcttSS-fBHI!#* 



Full name of sole or first inventor 
Hiroshi OKUBO 



an 



Inventor's signature 



Date 



mm 



Residence 

Yokohama-shi 



Kanaeawa 



Citizenship 
Japan 



146-0095 B#B*JR»*ffle£«Jll2TS8#5* 



Post Office Address 
c/o NAMCO LTD. 

8-5, Tamagawa, 2-chome, Ota-ku, Tokyo 146-0095 Japan 



Full name of second joint inventor, if any 
J^shiyjjkLKOJKE-— 



Second inventor's signature 



Date 



Residence 

. Kawasaki-shi , 



,Kanagawa , Japan 



Citizenship 
Japan 



146-0095 B*BJKft«*ffle*«Jll2TS8#5-S 



Post Office Address 
c/o NAMCO LTD. 

8-5, Tamagawa, 2-chome, Ota-ku, Tokyo 146-0095 Japan 



, (Supply similar information and signature for third and subsequent 
joint inventors.) 
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sr the Paperwork Reduction Act of 1 i 
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of information unless it displays a valid OMB control number. 



Japanese Language Declaration 



James A. Oliff, (Reg_220J!£U 
William P. Berridge, (Reg £ _30 l Q24L_ 
Kirk M. Hudson, (Reg^22£fi2l_ 
Thomas J. Pardini, (RegJ3&41lX. 
Edward P. Walker, (Reg^USQl 
Robert A. Miller, (Re g. 32.771) 
Mario A. Costantino, (Reg. 33 j65) 



POWER OF ATTORNEY: As a named inventor, I hereby appoint the 
following attorney(s) and/or agent(s) to prosecute this application 
and transact all business in the Patent and Trademark Office 
connected therewith, (list name and registration number) 

James A. Oliff, (Reg^ 27,075) 

William P. Berridge, (Reg . 30,024) 

Kirk M. Hudson, (Res. 27.562) 

Thomas J. Pardini, (RegJOJIli 

Edward P. Walker, (Reg. J3L450) 

Robert A. Miller, (Reg. _32J21X 

Mario A. Costantino, (RejJ33j565X_ 



OLIFF & BERRIDGE, PLC 
P.O. Box 19928 
Alexandria, Virginia 22320 



Send Correspondence to: 

OLIFFJlMRHDGE^PLC 
" P : 0_Box_l9928^ 
Alexandria, Virginia 22320 



OLIFF & BERRIDGE, PLC 
(703) 836-6400 


Direct Telephone Calls to: (name and telephone number) 
OLIFF & BERRIDGE, PLC 
(703) 836-6400 






Full name of third joint inventor, if any 
Yutaka ITO 








Third inventor's signature 
XuTCiAciV Tto 


Date 


<m 




Residence 

Yokohama-shi . _ Kanagajflia 


_ , Japan Jf^. 


mm 

B* 




Citizenship 
Japan 




146-0095 a*HJKSt«*He£»Jll2TB8#5-» 


Post Office Address 
c/o NAMCO LTD. 

8-5 Tamagawa, 2-chome, Ota-ku, Tokyo 146-0095 Japan 




4"H ft— 




Full name of fourth joint inventor, if any 
TetsukazuJ^AKAIjlStlL^ 








Fourth inventor's signature 

letsuk.«2.u MokahTshl 


Date 






Residence 
Yokohama-shi . Kanagawa 


, Japan ^SY^jf- 


B* 




Citizenship 
Japan 




&*& 

146-0095 B*B3fc5l?M;BE#lSJIl2Ta8#5-5§- 


Post Office Address 
c/o NAMCO LTD. 

8-5, Tamagawa, 2-chome, Ota-ku, Tokyo 146-0095 Japan 



,^ * ^ _ j. r-,4«> -I**, s,**.*-* ■» (Supply similar information and signature for fifth and subsequent 

(SB££t»©*PI*ra#tt3V^T*PI«tBB*U joint inventors.) 
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